A Visual Servoing System for an Amphibious Legged Robot

We present a visual servoing system for an amphibious legged robot. That is, a monocular-vision based servoing mechanism that enables the robot to track and follow a target both underwater and on the ground. We used three different tracking algorithms to track and localize the target in the image, with color being the tracked feature. Tracking is performed based on the object’s color, color distribution and color distribution with a probabilistic kernel. Output from the tracker is channeled to a proportional-integral-derivative controller, which generates steering commands for the robot controller. The robot controller in turn takes the steering commands and generates motor commands for the six legs of the robot. A large class of significant applications can be addressed by allowing such a robot to follow a diver or some other moving target. The system has been evaluated in the open water and under natural lighting conditions, and has successfully performed tracking and following of a wide variety of target objects.